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SUMMARY 



Despite the Vvxdespread use of verbal evaluations in social 
situations in general and the school-room in particular, little is known 
about what detennines the effectiveness of these evaluations in modify- 
ing behavior and influencing learning. Starting with the hypothesis 
that perception of the meaning of an evaluation may be an important 
determinant of its effectiveness as a reinforcer, a study was designed to 
investigate the following questions: Do characteristics of a verbal 

evaluation, such as content and intonation, determine what meaning the 
listener attributes to it? Do different children perceive the same 
evaluation differently? If such differences exist, are they related to 
personality variables, specifically anxiety, need for approval, need for 
achievement and locus of control? Do differences in perceptions of verbal 
evaluations relate to the effectiveness of the evaluations as reinforcers? 

Ninety- six fourth grade boys took part in the study. In initial 
group sessions, they were given tests measuring each of the personality 
variables. Following this, each child participated in two individual 
experimental sessions designed to obtain measures of his perceptions of 
various reinforcers. In both sessions, 36 taped evaluations were used, 
the Cf'ntent and intonation of which we'**e systematically varied in the 
following way: there were 12 statements, four of which had positive con- 

tent, four neutral and four negative; each statement was spoken with 
three different intonations - pleased, indifferent, and displeased. 

In session A, the child was told that the taped comments represented 
an art teacher speaking to various students about their work. After 
each comment was played to him, he was asked to respond on five-point 
scales to three questions, concerning the teacher's opinion of the child's 
work, the child's feeling after the comment, and the teacher's liking 
for the child. 

In session B, the child was presented with a guessing game task 
in which he was asked to assess his performance (i.e. , tell whether he 
had guessed correctly or incorrectly) on the basis of the taped evalua- 
tion played to him after each guess. 

In a final experimentc*’,! session three statements used in sessions 
A and B were selected to serve as reinforcers in a concept learning task, 
in an attempt to see if tue subjects' perceptions predicted their reactions 
to the reinforcers in this situation. Two experimental groups received 
the same reinforcer in this session ("I see" said with negative intonation). 
Subjects assigned to the first experimental group had previously perceived 
this as positive; those assigned to the second experimental group had per- 
ceived it as negative. There were also two control groups, the first 
receiving a reinforcer which they had perceived as very positive 
("excellent"); the second, one perceived as very negative ("pretty bad"). 
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School records were, used to obtain grades and achievement ana in- 
telligence test scores for each subject. 

Analysis of the results of the study showed that perceptions 
were influenced by content to a very great extent, and by intonatioii to 
a lesser extent. A content by intonation interaction was obtairxed, in 
which neutral intonation appeared to weaken (or "flatten”) the effect 
of non-neutral content. 

Attempts to relate personality variables and intelligence to the 
reinforcer perceptions showed that only locus of control, a variable 
which measures the degree to which one feels responsible for what happens 
to him, related positively to perceived meaning; children with a strong 
sense of responsibility saw the evaluations as more positive. 

Because these personality variables did not adequately account 
for the consistent differences in perceptions which w^ere found between 
children, it was suggested that parental styles of reinforcement should 
be investigated as probable determinants of these perceptual differences. 

A derived measure, "content- intonation sensitivity", showed a 
wide range in the relative importance of content and intonation to dif- 
ferent subjects' perceptions (although very few were more influenced by 
intonation than by content); this measure was found to be significantly 
related to anxiety, so that highly anxious children were relatively 
more sensitive to intonation and less anxious children more sensitive to 
content. 



The results of the third session, in which the link between re- 
inforcer, perception, and learning was to be determined, were marred by 
a strong dimension preference in the concept formation. Looking at the 
data in several ways partially obviated this problem, however, and sug- 
gested that there was evidence that perception of the evaluation does 
affect the influence that evaluation has on subsequent behavior. Thus, 
the same statement may have the effect of either increasing or decreasing 
behavioral responses for different children, consistent with whether 
they perceive the statement to be positive or negative. 

The degree to which the present results can be generalized to 
classroom situations cannot be known without additional research. It can 
be pointed out that children in classrooms have the opportunity to be- 
come familiar with teachers' reinforcement styles, while those in the 
present study were responding to comments of an unfamiliar, disembodied 
voice. These facts might lead one to expect a smaller amount of varia- 
tion between children in perceptions of i^arious evaluative statements of 
teachers in classrooms. If, however, further research shows that these 
results, particularly with regard to perceptual variation, do generalize 
to classrooms to some degree, certain implications for educational 
practice will be plausible. It might be inferred, for example, that a 
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teacher, when speaking to a class as a whole, might increase the like- 
lihood that all the students would interpret her evaluation statements 
in the same way by using either very positive or very negative state- 
ments with matching intonation; and that she should take special care 
with comments i.ntended to be noncommital, for some students might inter- 
pret them as praise, others as criticism. It might also be inferred, 
perhaps most appropriately, that the teacher should attempt to learn 
how each child interprets her evaluations, in order to be able to convey 
her precise intended meaning to each one. Although this last suggesto.on 
would be the most difficult to implement, attention to this problem could 
well result in more effective teaching. 



INTRODUCTION 



Statements of verbal evaluation com.prise a sizeable proportion 
of speech. We may assume that those who produce such statements usually 
have implicit expectations about how they will affect the people to 
whom they are directed. The use of verbal evaluations is especially 
widespread and important in schools, where teachers attempt to bring a out 
desired behavior by praising, scolding, or simply informing student.^ about 
the adequacy of their work. Some teachers seem to assume that different 
students will respond identically to the same statement of evaluation, 
and that these responses will correSpond to the intended meaning, 
whether positive, negative or neutral. Other teachers, apparently expect- 
ing or perceiving some variation among children, use different evaluation 
statements to influence different students. 

Research dealing with the effects of verbal evaluations or rein- 
forcers has for the most part ignored the possibility of individual dif- 
ferences in response to such evaluations. (See reviews by Stevenson, 

1965; and Parton and Ross, 1965). Bijou and Baer (1963), who have con- 
tended that research in this area has been inconclusive and contradictory 
becauL of such omissions, believe that the effect of particular social 
reinforcers may vary widely from child to child: 

Social reinforcers tend to be different stimuli for different 
children - approval is a positive reinfor.cer for one child, a 
negative reinforcer for a second, indistinguishable from any 
form of attention for a third, and a neutral stimulus for a 
fourth. The second child may respond to disapproval as a pos- 
itive reinforcer; the third child may respond to attention, 
approval, disapproval, affection, anger or reflection of feel- 
ings as equally effective positive reinforcers; the fourth 
child may respond to no social stimuli as functional, (1963, 

pp. 211-212). 

Those studies which have investigated relationships between certain 
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individual difference variables and subjects' responses to particular 
social reinforcers have presented some evidence that such personality 
characteristics as dependency, anxiety and need for approval relate to 
verbal c onditioning or probability learning with such verbal reinfoicers 
as "good", "fine", and "uh-huh". Little attempt has been made, however, 
to demonstrate the mechanisms which mediate such effects. 

Intervening processes have sometimes been suggested as explana- 
tions of the connection between reinforcers and learning outcomes in 
verbal conditioning research (e.g. Dulaney, 1961). One variable which 
has been investigated in several studies, and which can be considered 
such an intervening process, is the subject's "awareness" of the con- 
nection between the reinforcer and the rein^ "treed response; however 
there is little agreement about the role of awareness in such research 
(Levin, 1961; Spielberger, Levin and Shepard, 1962; Oakes, 1967; 

Thaver and Oakes, 1967; Baer and Goldfarb, 1962; Wong, Harrison and 
Stopper, 1966). A smaller number of studies have studied the subjects' 
perceptions of the meanings of reinforcers as conditio, ng or interven- 
ing variables. In one, a verbal conditioning experiment by Handler and 
Kaplan (1956), the subjects were asked at the end of the esqjeriment for 
their perception of the meaning of the reinforcer used ("ram-hmm"). 

Those who perceived it as positive had increased the reinforced behavior, 
while those who perceived it as negative had decreased the reinforced 
behavior. A similar study by Cairns and Lewis (1962) also included 
measures of dependency and found that high dependent subjects tended to 
hear "mm«hmm" as pleasant, while low dependent subjects heard it as un- 
pleasant or neutral. Those who considered it positive also showed sig- 
nificantly greater conditioning. 

A sizeable body o'" research has accumulated relating the effects 
of variations in types and schedules of social reinforcement (verbal and 
non-verbal) on children's performance in different learning tasks (Cran- 
dall, Good and Carndall, 1964; Gewirtz and Baer, 1958; Hill and Steven- 
son, 1965; Kelly and Stephans, 1964; Antonitis, Frey and Baron, 1964; 
Walters and Foote, 1962; Zigler and Kanzer, 1962; Travers, VanWagenen, 
Haygood and McCormick, 1964; McCoy and Zigler, 1965). Gac, particularl'7 
interesting study, reported by Wiener (1966), related race and social 
class differences in children to the effectiveness of two types of 
reinforcers; statements of approval accompanied by positive intonation, 
and statements of approval accompanied by flat or neutral intonation. 
Middle-class, white children learned equally well under either condition, 
while lower-class Negro children learned only under the condition in 
which both content and intonation were positive. These results were 
thought to reflect cultural differencies in experience with use of these 
two "communication channels", eventuating in perceptual differences be- 
tween the two groups. The children's perceptions cf the meanings of the 
reinforcers were not actually measured, however. In another study, con- 
ducted by Mehrabian and Wiener (1967), verbal stimuli were used which 
encompassed all combinations of three levels of content and three levels 
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of intonation (positivej neutral and negative in each ';ase;. Tne sub- 
jects were asked to judge the speaker's attitude from the verbal 
(a judgment which can be considered one kind of perception)^ Tnc stimuli 
were not presented as reinforcers , although several of them ccuid easily 
be construed as such. It was found that intonation was a more unportant 
determinant of judgment of speaker attitude than was content- 



In summary} there is some evidence which indicates that perscn- 
ality characteristics relate to responsiveness to particular verbal re- 
inforcers, that the perceived meaning of the reinforcers may rei^atc tc 
such responsiveness, and that content and intonation may aCiecc respon- 
siveness to and perception of verbal statements. 

The investigation to be reported here is based on the assumpL.on 
that the effect of verbal reinforcers is mediated through the percuj.v/'ed 
meanings of the reinforcersj it represents an attempt to unity the un.v*- 
ings discussed above by combining variables previously studied separately 
in disparate research areas. 

The major objective of this Investigation was to expiore possj.ble 
antecedents and consequents of differences in children's perceptions ot 
verbal reinforcements. It was hoped that we might discover whet tier dif-* 
ferent children perceive the meaning of certain verbal reiniorcers dif- 
ferently; whether such differences can be accounted for la part by 
ferences in certain personality characteristics; whether certain stimu-us 
characteristics (content and intonation) of the verbal reinfoicec cc^i- 
tribute to differences in the perceptions; and whether differences in 
perception relate to performance differences when the same reinforcements 
are used in learning tasks. 

It was expected that individual differences in percepti.or. would 
be maximized under conditions in which content and intonation were 
neutral or contradictory, and minimized under conditions in which both 
were positive or botn negative, since as statements' -’mbiguity decreases, 
the perceptual variation which Indepcncent variables might inlluence must 
also decrease. Four ner^^onality-related characteristics were selected 
which seemed muost likely to be related to differences in reinforcer per- 
ceptions; these were anxiety , need for achievement , locus o f control, and 
need for approval. The following general predictions were made*, 



1, Anxiety . More anxious children were expected to be more likely to 
perceive negative meanings in the reinforcements. This hvpothesis was 
based on the assumption that anxiety produces a sensitization, tc fright.- 

enittg or painful events as a means of protecting against them. 

2, Need for Achievement . Children with higher nAch scores were expected 
to be more likely to perceive positive meanings in the reinforcuinents. 
Since positive reinforcements are indications to the child th t he is 
achieving well, the perceptions of those who have this need relatively 
strongly should be oriented in the positive direction. 
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3, Locus of Control . This refers to the degree to which the child con- 
siders himself, as opposed to some other person or thing, responsible 
for the positive and negative reinforcements which he receives. A 
child who believes he can control his own reinforcements should be more 
likely to expect them to be as he wishes them; therefore those who score 
higher on this variable should have more positive perceptions of the 
reinforcements. 

4. Need for Approval . Two conflicting hypotheses can be made for this 
variable. On the one hand it might be expected that children with stronger 
need for approval should attempt to perceive approval in the reinforce- 
ments which they receive, and therefore should have more positive reinforcS" 

ment perceptions. On the other hand, children scoring high on a need 
for approval measure have been shown to have low expectancies for social 
and academic success (Crandall, 1966); this might lead one to predict a 
negative relation.r.hip between need for approval and positivity of reinfor- 
cer perception. 



METHODS 



The subjects for this study were fourth grade boys from two 
schools in a middle-class Chicago suburb. The first three sessions of 
the study took place in the spring of 1967, with 96 boys participating; 

48 of f ese subjects were seen the following fall for a fourth session. 

The initial session was designed to obtain measures of the four 
personality variables selected for the study. The subjects were divided 
into three groups, and two experimenters (the authors) administered the 
following tests to each group separately: the Children’s Manifest Anx- 

iety Test ''’.as: neda, McCandless and Palermo, 1956), the Children’s 
Social Desire ? ty Questionnaire (a measure of need for approval de- 
scribed in Crandall, Crandall and Katkovsky, 1965), a test of Intellectual 
Achievement Responsibility (measuring children’s locus of control and 
described in Crandall, Katkovsky and Crandall, 1965), and a scale of 
Achie'^^'ement-related Affect (developed by the investigators as a measure 
of need for achievement, and described in Appendix A). The tests were 
put into two booklets, one containing the lAR and Social Desirability 
questionnaires, the other containing the Anxiety and Achievement-related 
Affect measures. To insure that the subjects understood the questions, 
one experimenter gave the instructions and then read the questions aloud, 
one by one, as the boys marked their answers in the booklet. In addition 
to these measures, IQ, school grades and achievement test scores were 
obtained from school records for each subject. 

Soon after the initial session, subjects took part in two exper- 
imental sessions designed to measure their perceptions of verbal rein- 
forcers. The order in which the sessions were presented to each subject 
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was varied, so that about half the subjects experienced session A first 
and half session B. Regardless of the order, a two to three week time 
period separated the two sessions, both of which were conducted by the 
same female experimenter. Session A attempted to assess the child’s 
perception of a series of "vicarious reinforcers" (not directed to him), 
while in session B, his perceptions of reinforcers which concerned his 
performance and were directed to him were obtained. The former allowed 
a more finely graduated response scale, while the latter seemed more 
relevant to typical reinforcement situations. 

Each session used a series of reinforcers, or verbal evaluations, 
which included all combinations of three levels of content (positive, 
neutral and negative) and three levels of intonation (pleased, indif- 
ferent and displeased). There were four different statements for each 
content level, each repeated once with each of the three types of inton- 
ation, for a total of 36 reinforcers. In order to allow a check for 
reliability, half of the statements for each content category were 
identical for sessions A and B; the decision about whether a reinforcer 
was to appear in both sessions, in A only, or in B only, was based on 
the experimenters’ judgment ai to the appropriateness of the reinforcer 
in the context of the session. (Appendix B contains a more detailed 
description of the method of selection of the reinforcers and a list 
of the reinforcers used in the two sessions.) 

Tape recordings were made of the two lists in order to keep the 
stimuli constant for the different subjects. The voice on the recordings 
was that of a local actress. Three different orders of the 36 rein- 
forcers within each series were made so that It would be possible to check 
on order effects. These orders were randomly generated with constraints 
to avoid adjacent appearances of two items in the same content and inton- 
ation categores, two items with identical contents, or three items in 
the same content categories or in the same intonation categories. The 
items in each order were copied from the same original recordings. Each 
order was presented to about a third of the subjects in each session. 

In session A, the subject was brought to a small room in his 
school and seated at a table across from the experimenter. He was told 
that he was going to hear comments made by a teacher to different students 
during an art class, and that after hearing each one, he would be asked 
to answer three questions, each with five possible answers: "What did 

the teacher mean? .•• The drawing is: 1) very bad; 2) sort of bad; 3) 

so-so; 4) pretty good; 5) very good." How does the child feel? ... He 
feels: 1) very unhappy; 2) sort of unhappy; 3) neither way especially; 

4) pretty happy; 5) very happy." "Does the teacher like or dislike the 
child? ... The teacher: 1) dislikes him very much; 2) dislikes him a 

little; 3) neither likes nor dislikes him; 4) likes him a little; 5) 
likes him very mucli. " 
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The child was presented a copy of each question and its possible 
answers for reference during the session, and after a practice example 
was given to make certain that the subject understood the rating pro- 
cedure (with "not so good" spoken by E as the reinforcer), the 36 taped 
coii-mients were played to him, one at a time, and his three ratings for 
each comment were obtained immediately after he had heard it. These 
ratings were made verbally to the experimenter, who then recorded them. 

Session B was designed to get measures of the children's per- 
ceptions when the reinforcing experience involved them more directly. 

For this, it was necessary to devise a task in which the child actively 
participated, and yet received no feedback about his performance other 
than that provided by the reinforcer. The following "game" was devised 
to fit these requirements. 

A tape recorder was enclosed, and concealed, in a 20"x20"xl0" 
hardboard box, painted blue. On the front of the box were the words, 
"GUESS IT GAME", a small cloth-covered speaker opening, a signal light 
above three small buttons (on the left), and two buttons, labelled 
"wrong" and "right" (on the right). On the back of the box were lights 
which were lit by the buttons on the front, a button to light the start 
signal, and a switch to start and stop the tape recorder; these enabled 
the experimenter to operate the apparatus and record the subject's 
responses. 

Each child was told that this was a new game, the Guess it Game. 
When the light came on, he was to guess which of the three buttons on 
the left was the correct one to press. Following his choice, the game 
"commented" about his guess. After listening to the comment, the sub- 
ject was to indicate whether he thought his guess had been correct or 
incorrect by pressing the "right" or "wrong" button. When the experi- 
menter had given two "practice turns", for which "right" and "no" (with 
neutral intonations) were the taped reinforcers, and the subject appeared 
to understand the procedure, the "game" began, and continued until all 
36 experimental comments, or reinforcers, had been played. For each com- 
ment, the experimenter recorded two measures: the subject's judgment of 

right or wrong, and the time between the end of the recorded comment and 
the subject's response (latency); the latter measure was obtained with a 
stopwatch. 

The purpose of the final session was to learn whether a subject's 
perception of a reinforcer would predict the effect of the reinforcer 
on his performance in a learning task. Because the selection of rein- 
forcers for this session depended on some analysis of the results of 
sessions A and B (which had occurred near the end of the spring school 
semester), there was a delay of several months, until well into the 
following fall semester, before this final session was run. Only 48 
of the original 96 subjects participated in this last phase of the ex- 
periment; this rediiction was necessitated by some subjects' having moved 
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during the interval and others failing to meet the criteria established 
for the task. These 48 subjects were divided into four groups, two 
experimental and two control, with twelve subjects in each group. The 
four groups represented four reinforcer conditions, with the reinforcers 
selected from those used in both of the earlier sessions. The reinforcer 
used with the first control group was "excellent" s. d with pleased in- 
tonation; all subjects in this group had previously perceived this as 
highly positive. The second control group *s reinforcer was "pretty bad" 
said with displeased intonation; this had been seen as highly negative 
by all subjects in this group. The two experimental groups were both 
assigned the same reinforcer, "I see" said with displeaiied intonation. 
Subjects in the first experimental group had previously perceived this 
as moderately or slightly positive in session A, and as "right" in 
session B; subjects in the second experimental group had perceived it as 
moderately or slightly negative in session A, and as "wrong" in session 
B. (There were no S's who had perceived this as strongly positive or 
strongly negative, nor was there any other reinforcer which had been 
seen at the two extremes in sufficient numbers to be used for these ex- 
perimental groups). 

The reason for including control groups with very strongly dif- 
ferentiated reinforcers was so that the function of these reinforcers 
might be compared with that of the differentially perceived neutral re- 
inforcer used with the experimental groups. If the learning behavior 
of the children in the experimental groups were similar to that in the 
control groups, there would be strong basis for the assumption that the 
neutral reinforcer was in fact functioning as a positive reinforcer for 
some children and a negative reinforcer for others. 

The learning task was a variant on a concept formation paradigm. 
The subject responded to a series of stimulus cards, each containing 
three figures which combined two colors (chosen from red, blue or green) 
and two shapes (chosen from square, circle and triangle). The figures 
were aligned horizontally on the stimulus card in such a way that the 
left-most figure had the same shape as one of the other two figures, and 
the same color as the remaining one. For example, a stimulus card might 
contain a red circle (at the left), a red square, and a blue circle. 

There were 36 such cards, each containing a different combination of form 
pair/color pair. 

The stimuli were presented with an apparatus consisting of a 
tape recorder enclosed by a 16" square yellow box, on the front of which 
were three 3"x2^" windows which could be closed simultaneously by a 
guillotine door on the inside of the box. Beneath the left-most window 
was an X; each of the other windows had a button beneath it. A small, 
cloth-covered speaker opening was also on the front of the box. The 
stimulus cards were inserted behind the windows inside the apparatus; 
when the guillotine door was raised, a figure appeared in each window. 
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Each subject was instructed to push the button under the window 
of the picture that "belonged with" the picture in X. One reinforcer 
(corresponding to the group to which he was assigned) was also played to 
him as an example of what "the game might say" to him. (This was to 
avoid the possibility that some subjects ^ selecting and retaining a non- 
reinforced concept, might never hear the reinforcer). The subject was 
then presented with the stimulus cards, one at a time, until he had 
responded in the same way (either to color or to shape) six times in a 
row, or until all 36 stimulus cards had been shown. Based on random 
assignment prior to the session's start, half the subjects in each group 
were presented the reinforcer whenever they responded to shape, the other 
half whenever they responded to color. It was assumed that S's who 
learned the reinforced concept would be treating the reinforcer as pos- 
itive, and those who learned the nonreinforced concept would be treating 
it as negative. Our purpose here was to see how this accorded with their 
earlier perceptions of the same comments. All responses were recorded 
by the experimenter throughout the trials. 



RESULTS 



Reliability and Validity of Measures 

Reliability of the perception measure was assessed with a com- 
parison of subjects' responses to the two occurrences of those items 
which were used in both session A and session B. Table 1 presents percent- 
ages of consistent responses across the two sessions for the repeated items, 
within each intonation condition. Responses to question 1 only were used 
from session A in this analysis ("What did the teacher mean?") since 
this question seemed the most comparable to the "right" or "wrong" judg- 
ment required of the child in session B. Subjects who scored 3 (neutral) 
in their responses to the session A question were eliminated from these 
comparisons because such a response could not clearly be said to be 
either consistent or inconsistent with the forced "right" or "wrong" of 
session B. Inspection of the Ns presented in Table 1 indicates that 
most of the cases omitted in this way fell in the neutral categories, as 
would be expected. The consistency percentage was computed, for each 
category, by summing the number of Ss who rated 4 or 5 on question 1 in 
session A and also judged "right" for the same comment in session B with 
the number who rated 1 or 2 in session A and judged "wrong" in session B, 
and dividing by the total number of non-neutral ratings for that item in 
session A. Table 1 indicates a generally high level of consistency 
across sessions, with most of the inconsistencies falling in the neutral 
categories^ It is interesting to note that, of a total of 119 sets of 
inconsistent scores in this analysis, 78% were relatively moderate ratings 
in session A (2's or 4's), while only IXL were extreme ratings in session 
A (1' s or 5' s). 
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Table 1, — Percent Consistency of Perceptions between 
Sess, A, Ques. 1, and Sess. B, Judgment‘S 



Reinforcer 


Intonation 


Positive 


Neutral 


Negative, 


% 


N 


% 


N 


% 


N 


Excellent 


100 


96 


96 


90 


95 


96 


Very good 


98 


96 


90 


81 


95 


94 


Take your time 


63 


54 


75 


40 


96 


74 


I see 


81 


36 


61 


31 


82 


22 


Not very good 


89 


80 


92 


83 


92 


87 


Pretty bad 


94 


94 


93 


87 


96 


92 



^Subjects who rated an item as *3* or neutral, during Sess. A 
were eliminated from the table for that item. 



A rough eheck on the validity of the content and intonation man- 
ipulations is provided by Table 2, which presents means, for each judg- 
ment, for the 12 items in each content condition (averaging across in- 
tonations) and the 12 items '*n each intonation condition (averaging 
across contents). In every case, the "positive” category was reported 
as more positive than the "neutral" category, which was more positive 
than the "negative" category. The differences are much less pronounced 
for the intonation than for the content categories, 

A total score was derived for each of the nine content- intonation 
cells by summing the four items in each. These total scores were assessed 
separately by session and used in most of the analyses involving sessions 
A and B. 

Data relevant to assessing the reliability of the personality 
variable developed for this study, the measure of Achievement-related 
Affect, are presented in Appendix A. The intercorrelations presented 
there appear to indicate that several dimensions may be represented in 
the scale, as presently constituted. 

Determinants of Perceptions 

Effects on the independent variables were examined in a series 
of four-way analyses of variance. Each analysis included one personality 
variable (trichotomized so that the possibility of nonlinear trends could 
be investigated), the three levels of contenr., three levels of intonation, 
and three orders. Dependent variables were the perception scores from 
each of the three questions in session A, and the perception responses 
to the game in session B. These were mixed-model analyses of variance, 
with repeated measures on content and intonation. Techniques described 
by Winder for computing analyses of variance for data with unequal cell 
frequencies (1962, pp. 241-244) and with repeated measures on some var- 
iables (1962, ch. 7) were utilized in these analyses. It was decided 
also to examine the possible effect of achievement- related variables on 
these perception scores. Since the intelligence and achievement measures 
were highly inter-related (see Appendix C, Table 12), IQ was selected 
as the most general measure of intellectual level. This was trichotomized 
and used in 4-way analyses, just as the personality variables were. 

The complete results of these analyses are presented in Appendix 
D, Tables 13-17. Of the five individual difference variables represented 
in these analyses (including I.Q.), only lAR showed any significant 
direct effect on perception; children scoring high on this measure tended 
to respond to question 1, session A (What did the teacher mean?") more 
positively than those scoring low (F = 4.10; 2, 87 df, p^.05). Means 
for the three lAR levels are presented in Table 3, 



12 



Table 2. — Means of Content and Intonation Classes 



a 



CO 

(U 

u 

s 

CO 

(d 






CO 

s 

o 

•H 

(d 

> 

o 







d) 

»% 














5 


cs 


o; 




cs 






4J 


\D 


to 


CO 




bCi 




Cd 


• 


• 


• 


• 


a 




txCi 


tH 


rH 


cs 


tH 


tH 




d) 


tH 


tH 


rH 




u 




55 










O 














c 




rH 










M 4J 




« 




CO 


CS 


CJ> 


c 




P 


iH 


CS 


tH 


00 


0) 




P 


• 


• 


• 


• 


53 P 






C4 


cs 


CO 


tH 


o C 




0) 


tH 


H 


tH 




o 




Is 










4J O 














cd 














53 




0) 










o 




> 










4J 






O 


CO 


at 


\o 


c 




4J 


CO 




to 


tH 


M 




•H 


• 


• 


• 


» 






CO 


CM 


cs 


CO 


CS 






o 


rH 


iH 


tH 








p- 




















0) 














5 






rH 








4J 






\o 


cs 






Cd 


• 


• 


• 


• 


W. 




w 






O 




d 




(U 










•H 




Sz: 










U 














o 53 














53 O 




tH 










bO *H 




Cd 




o 


r^ 


o 


M P 




IM 


to 




to 


00 


w nj 




4-J 


• 


• 


<• 


• 


53 




d 


tH 


H 


cs 


tH 


P o 




0) 


tH 


tH 


tH 




53 P 




Jz; 










(L) 53 














4J M 














d 




(U 










o 




> 










u 






CS 


CS 


Oi 








4J 


cs 


»H 


CO 








•H 


• 


• 


• 


• 






0) 






UO 


CO 






o 


rH 


rH 


rH 








pH 






















4-J 








tH 


CS 


CO 


d 














0) 








• 


• 


• 


6 








CO 


CO 


CO 










0) 


0) 


0) 


■D 








a 


d 


d 


d 




0) 




O’ 


o 


o 






o 












cd 


u 




9\ 


0\ 


9\ 




4J 


d 




■< 


< 


< 


P 


(d 


o 












P 


CO 




• 


• 


• 


A 








CO 


10 


U) 


to 








CO 


CO 


to 


CO 








0) 


0) 


0) 


0) 








CO 


CO 


CO 


CO 



d 

o 

M 

CO 

0) 

d 

C' 



c 

d 

o 

•H 

CO 

CO 

(U 

cc 



'cd 

M 

(U CO 
0) 0) 
IS 

4-J O 
0) U 
,Q CO 



rd 

CO 

d 

o 

•H 

4J 

fd 

tH 

(U 

A4 





High 


12.44 


CO 






p 






d 






o 


6 


CO 


u 


d 


cs 


o 




» 






cs 




0) 


tH 




S 




M 














u 


cn 




o 


• 






tH 






tH 



c 



CO 






(U 


0) 


d 


rH 


Cd o 


rO 


(U a 


(d 


S CO 


EH 






Trom four-way analysis of variance (Table 13, Appendix B) 






Order was included in these analyses in order to investigate 
the possibility that it might be producing spurious relationships be- 
tween other variables or sets of variables whose effects we were in- 
terested in. Order showed significant interactions witn Social De- 
sirability (session A, question 3; F ~ 2.68; 2, 87 df, p^.05) and 
with Anxiety (session B; F = 3.69; 2, 87 df, pc.05). Neither of these 
variables, however, reached significance in their direct effects, al- 
though the latter approaches it. Order also showed small, but signif- 
icant interactions with content in both sessions A and B. However, the 
content direct effects were so strong, as will be seen presently, that 
it is obvious that the slight differences produced by the different 
orders cannot alter the general picture of the content effect. 

The content X intonation cell means for sessions A and B are 
presented in Tablii 4. In every case, content has a highly significant 
direct effect (p<.001), much stronger than that of intonation, although 
each of the intonation effects is also highly significant (p<.001). The 
content effect is strongest on responses to the first question of the 
three asked in session A, while the intonation effect appears to be 
strongest with question 2 ("How does the child feel?"). (These direct 
effects can be seen most clearly in Table 2). The content X intonation 
interactions take somewi it different forms for the different sessions 
(Table 4). For each oi .he three questions in session A, positive con- 
tent is perceived least positively in the neutral intonation condition, 
and slight ly more positively with positive than with negative intonation. 
Similarly, negative content is perceived least negatively in the neutral 
intonation condition, while again slightly more positively with positive 
than with negati\ i intonation. For neutral content, in each of the 
three questions, positive and neutral intonation are perceived about 
equally, and each more positive than negative intonation. In session B, 
intonation shows little effect in the positive and negative content con- 
ditions, although in the former it appears that positive intonation is 
perceived more positively than neutral or negative, which are perceived 
about equally; while in the latter it appears that negative intonation 
is perceived more negatively than neutral or positive, which are per- 
ceived about equally. The major effect of intonation, however, is ap- 
parent in the neutral content condition, where positive intonation is^ 
perceived more positively than neutral, which is perceived more positively 
than negative intonation. 

In order to investigate the possible role of personality variables 
more fully, it was decided to test for linear and quadratic trend effects 
within the cell which was expected to be most likely to allow personality 
effects; the cell which combined neutral content with neutral or in- 
different intonation. Xesults of these analyses are presented in Table 18, 
Appendix D. The only significant effects are, again, with the lAR 
measure. There is a significant linear trend with responses to session 
B, judgment (Table 5), with higher lAR scores relating to more positive 
perceptions. The relationship which was significant in the overall 
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Table 4. — Means and Standard Deviations of Content- 

Intonation Cells 








• 


lO CT> CO 


iH in iH 


0\ St U3 


1^ H 








cv] <r <r 


\0 \D 


CO CO o> 


VO ID in 






• ’ 


< « f 


• • • 


r • • 


• • 0 






CO 


iH iH iH 


iH iH iH 


CM CM CM 






0) 




























•H 

•P 

0) 

tiC 












, * 


0 


CO <1 iH 


CO 


rs St o 


VO VO 




<D 


CO 


Ok iO CO 


H \0 O 


a. CM in 


CM CM rH 






<D 


/ • • 


• • • 


• • ■ 


• • • 






00 \o 


00 00 


O H Ch 
H H 










• 


C30 O CTi 


\D m 


m 


CM <r 








•a- to 


00 a. 


rH rH rH 


Ok H 






• 


• • 0 ' 


• • • 


• • • 


• • • 






CO 


iH iH iH 


iH rH tH 


CM CM CM 


H 


c 


fH 












(U 


0) 

u 












•p 












a 


p 












o 

o 


0) 


a 


kT CO H 


H <r o 


00 CO VO 


H CO Ok 


iz: 


CO 


H H in 


CO CO CO 


OV rH Sf 


CO Cn, CO 






0) 


# • • 


• • • 


• • • 


• • • 








04 <S O 


CM CS C 


C4 CO iH 


CM H H 








iH iH iH 


H H rH 


iH iH iH 














CM CO 00 


CO r> <r 






• 


O 00 00 


o 00 m 


00 CO CO 


CO 00 






p 


, H 00 <r 


\o O 00 


• • • 


• • • 






• 


# • • 


• • • 


CM CM CM 








CO 


iH rH iH 


iH C4 rH 








% 














•H 














P 














•H 














CO 

o 


0 


CO H O 


H 0> 00 


in 00 H 


CM 00 CO 




PM 


CO 


tH 00 VD 


H CS 


00 o 


cr> VO VO 




0) 


• • • 


• • • 


• • • 


a ■ • 






je; 


00 tn 


00 m 


VO sf vo 


CO CO CO 








iH iH iH 


iH iH iH 


rH H rH 






CJ 

0 




(U a) 


(U d) 


(U fl) 


p p 




•H 




iH ^ 


f> rH > 


^ n! 


i> rH ^ 




P 




•H Cd *H 


•H (d *H 


•H P •H 


•iH P *rH 




CO 




P M P 


PUP 


P P P 


P P P 




(rj 




•H P (d 


iH P (d 


•H P P 


•H P P 




o 




CO bCy 


CO p OO 


n P oc 


n p 00 




P 




o (U (U 


O (U (U 


O P P 


O P P 








P; CS CJ 


P P P 


p P P 


p p p 




H 


























0) 




^ iH 


<! CM 


<J CO 


pq G 

0) 

^h4 




a 




• • 


• • 


• • 


• p 




M 




m CO 


CO CO 


m m 


m 00 




0 




CO (U 


CO 0) 


m p 


W TJ 




o 




(U P 


0) 


p P 


p p 




CO 




CO c 


CO o 


CO O 


CO 




analysis, that between lAR and responses to question 1, sessior. A, 
is reduced to a borderline relationship (p^.lO) in the present analy- 
sis, although the trend is in the same direction. 



Table 5. — Summary of Trend Analysis for lAR Effects on 
Neutral Cell Scores, Sess. B, Judgment^ 





lAR Group 


Mean 


Low 


Medium 


High 


Score 


1.46 


1.70 


2,02 



F linear = 5.24, df = 1 and 87, p 05 



The effects of content and intonation on response latencies in 
session B was also examined with an analysis of variance. Results of 
this analysis are presented in Table 6, ^gain, there is a very strong 
direct effect for content, £nd weaker, but significant effects for in- 
tonation and the content x intonation interaction. Neutral content 
receives the longest latencies, with the peak in the neutral content - 
neutral intonation cell. Negative content also receives the longest 
latencies when combined with neutral intonation, although latencies are 
almost as long when it is combined with positive intonation. Latencies 
for positive content are longest when it is combined with negative, in- 
tonation, and shortest when combined with positive intonation. 

In one other set of analyses, the various personality measures 
were related to a measure of relative sensitivity to content or inton- 
ation which was derived from the present data. For each of the three 
questions from session A, each subject's score for the negative content - 
positive intonation condition was subtracted from his score for the 
positive content - negative intonation condition. Subjects with high 
scores would be relatively more influenced by content, those with low 
or negative scores would be more influenced by intonation. This was 
done only for session A because the 5-point scales allowed for more 
variation in scores. Correlations relating the personality measures and 
IQ to content- intonation sensitivity are presented in Table 7. Anxiety 
is signif icnatly related to this measure for questions 1 and 2, in each 
case with more anxious children being more sensitive to intonation. In 
order to test for nonlinear effects, analyses of variance were done with 
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Table 6. — Effects of Content and Intonation 

on Latency of Response in Session B. 



Summary of Analysis of Variance 



Source 


m.s . 


d. f . 


F 


P 


Content 


384.53 


2 


112.76 


.001 


Con X Sub 


3.41 


190 






Intonation 


19.09 


2 


6.68 


.01 


Into X Sub 


2.86 


190 






Subjects 


36.45 


95 






Con X Into 


12.13 


4 


4.76 


/.05 


Con X Into X Sub 


2.55 


380 







Content-Intonation Cell Means 



Intonation 




Content 






Positive 


1 

Neutral 


1 

Negative 


positive 


6.53 


8.87 


7.16 


neutral 


7.33 


9.42 


7.32 


negative 


7.43 


8.93 


6.66 
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Table 7 . 



Correlations among Content-Intonation 
Sensitivity and Personality Variables 



Personality 

Variable 


Content-Intonation Sensitivity 






Sess. A, Ques. 1 


Sess. A, Ones. 2 


Sess. A, Ones. 3 


lAR 


.03 


.09 


-.04 


Soc. Des. 


-.03 


.07 


-.02 


Anxiety 


-.24* 


-.30** 


-.03 


Ach-Aff 


-.13 


.01 


.16 


10 


.02 


.08 

-- 


1 

• 

o 

1 



*p ^ .05 

*01 



the same variables (presented in Table 19, Appendix D). Anxiety again 
was the only personality variable to show any significant effect: a 

nonlinear trend with question 3 (Table 8), with moderately anxious 
children showing the most content- sensitivity, and low or high anxious 
children, the most intonation sensitivity. 



Table 8. -- Relationship between Anxiety and Content-Intonation 
Sensitivity for Sess. A, Ques. 3^ 





Anxiety Group 


Mean 


Low 


Medium 


High 


Sensitivity 








Score 


4.44 


6.75 


4.09 



^ From a one-way analysis of variance, F = 5.70, df = 2 and 93, 

PC. 01 



Perception and Learning 

Percentages of subjects who reached a learning criterion in the 
final experimental session based on responding to the reinforcers con- 
sistently with the way they reported perceiving them in the earlier 
sessions are shown in the upper portion of Table 9. Thus, 50% of the 
S*s who saw "I see" said with negative intonation as a positive rein- 
forcer in the earlier sessions learned the concept reinforced with this 
comment in the final session, while 75% of those who earlier saw the 
same comment as a negative reinforcer learned the concept not reinforced 
with this comment. Comparison of the various columns of the upper 
portion of Table 9 shows that the two experimental groups were respond- 
ing less consistently than were the control groups. A Fisher Exact 
Test run on the two experimental groups did not show a significant re- 
lationship between initial perception of the comment and its later 
utilization in the learning task, although the trend for the negative 
perceivers is in the predicted direction. 

A reassessment of the reinforcer perceptions was made from the 
responses to the subject interviews at the end of the final experimental 
session. All of the 21 subjects in the control groups who saw the state- 
ment as an evaluation in that session perceived the meaning to be the 
same as they had in the earlier sessions; while only 11 of the 16 experi- 
mental subjects who saw the statement as an evaluation gave it the same 




19 



o 

u 

4J 

d 

o 



CO 

Q* rj 

d cd 
O 4J 
u o 



O 60 4J 



o 

m 

• 

00 



sf 

CNl 



vO 



CO 

cs 

• 

m 

os 



CM 



VO 



§ 

rl 

4J 

Cd 

*r\ 

rH 

4J 

& 

0) 

o 

£ 

5 

(4 

9 



04 

(U 

u 

u 

0) 

s 

0) 

> 

4J 

0) 

PO 

s- 

s 

4-^ 

to 

H 

iO 

s 

o 



Ov 

H 



I , “ 

•H H 0 ) 

H Cd P 4 H 
13 Cd 
O -M 
m O 

bO 4J 



0 ) 4 J 

g*d 

w 



o 

m 

c 

CM 

VO 



CM 



CM 

ON 

9 

as 



o 

m 

• 

00 



vO 

H 



CO 

rH 

c 

ON 



d ^ 

rO H 

0 ) 0 ) !-H 

>> > > p 
4J *H *H M 

4J 44 0) 4J 
0) Cd O 0 
V4 60 M Q 
0 ) 0 ) 

s d 04 ^-^ 



VO 



ov 



5:^ 



CO 

vO 



O 

o 

9 

o 

Q 



CO 

vO 



8 



4J 

•H 

'd 



u 



4J 

oi 

or 

o 

V4 

0) 

fm 

V4 

0) 

o 

V4 

o 

MH 

s 



0) 

0 ) 

CO 



*H 

*cd 

60 

0 ) 

d 



'd 



Cd 

4J 

I 

•H 

V4 

0 ) 



0 ) 

8 ^ 

0) H 

pus-/ 



o 

o 

uo 



o 

o 



CM 



s 

o 

Q 



in 

CM 



00 



Z 0 ) 

fi > 



0) 

0) 

CO 



•H 

4J 

CO 

O 

P4 



'd 



cd 

•p 

d 



0) 
o 

0) H 

P4 






O 

o 

• 

o 

n 






CO 

00 

• 

as 



o 

o 

• 

n 



o 

o 



00 



u >>_ 

C H TJ /-> 
(I) d) 0) rH 



H > 
rH *H 
0) P 
O *H 
>< CO 
H O 
Z P 4 P 4 ^ 



S 

0) P 

u § 
0) o 



CO 

CO 

• 

CO 

00 



CM 



o 

00 

VO 



o 

o 

• 

o 

<7N 



rv 

00 

vO 



I 



Tl 

0) 

CO 

CO 

0 ) TJ 



iZ! 



0) CO 



CO 

m 

cn 

p 

d 

0) 

o 

0) 

fu 






p 

s 

4J 
CO 
•H C 
CO 0) 

s aj 

u B 



g 

•H 



P 4 4 J 



00 

d 



P4 *H 

8 B 

M cd 
(U (U 
Pu H 



CH 

O 

O 

d 

8 

£ 



u 

o 

MH 



O 

P 



CO 



H 

^ 0) *H 
Cd p CO 
•H •H 
9-1 9-1 
P O 



P p 
d 9-1 
0 ) 0 ) 
P T9 
CO d 

o 

P4 

CO 

2i 







TJ 


















0) 


















CO 


Cd 
















CO 


iz: 














1 


W TJ 
















0) 

rO 


8 8 








9-1 

0 






CO 


1 








MH 






9 » 


P 


^ d 




MH 






P 


CO 


CO 


d 


8-S « 




0 


0 


d 


d 


9-1 




0) 




• 


P 


0 


.0) 


0) 


p 


p 


P 4 4 J a 




0 




*H 


p 


TJ 


d 


CO 






d 


CO 


9-1 


CO 


d 


0) 


•H 


d 0) d 






rH 


0) 


•H 


0 


0 


CO 


<u 0 5 




d 


Cd 


P 


CO 


O4 


9-1 

0 ) 


8 


0) M cd 
§ 0 ) d) 




«3 


T! 


*H 


§ 


CO 

0 ) 


ru 


0 


4 J O.H 






P 


0 


0 


9-1 



20 




^Subjects whose response to the post-session interview indicated that they did not 
perceive the statement as an evaluation were eliminated from this analysis. 



meaning as in the earlier sessions (68,8%). Results of this reassess- 
ment on subject consistency are presented in the lower portion of 
Table 9. It car; be seen that consistencyj assessed with respect to the 
post-session percepticnsg is greater for each of the four groups, 
markedly so fcr the two experimental groups. Six of the eight S's in 
the positive perception experiiriental group (as redefined) learned con- 
sistently, while all eight of those in the negative perception experi- 
mental group did soo A Fisher Exact Test on these data revealed a re- 
lationship significant at the ,01 level. 

Evaluati<^n of these results is made difficult, however, by the 
fact that a strong concept preference was found to be operating in this 
experimental session. As was mentioned, the reinforcers were distributed 
in such a way that selections according to form would be correct for half 
the subjects and selections according to color would be correct for 
the other half. But of the 24 subjects in the two control groups, 21 
(or 87.5%) selected form on the first trial, while 19 of the 24 experi- 
mental subjects (79.2%) did so. All 5 of the experimental group subjects 
whose perceptions changed from the earlier sessions to the final ses- 
sion changed in such a way that the meaning of the reinforcer became 
consistent with their selections on the initial trial. Excluding these 
five cases from, the 16 experimental subjects who savr the statement as a 
reinforcer (on the grounds that their ’perceptions' mmy have been just- 
ifications or rationalizations) leaves 11 experimental subjects, of 
whom 10 (or 90.9%) responded correctly in accordance with their earlier 
perceptions. However, in 8 of these 11 cases, the 'correct' response 
agreed with the subject's initial selection, or preference. Perhaps 
the strongest test of the effect of the reinforcers is with those sub- 
jects who had tc shift from the concept which they initially selected. 
There were nine such subjects in the control groups; seven of them 
(77.8%) changed in accordance with the prior perception, while the 
other two did not consider the statement a reinforcer. In contrast, 
only three out of eleven such subjects in the experimiental groups 
(27.37o) changed from, their initial selections consistently with their 
original reinforcer perceptions. (Three out of eight, or 37.5%, if 
the post-session non-perceivers are excluded; and three out of four if 
those whose perceptions had changed to accord with their initial trial 
selections are also excluded). To put this slightly differently, of 
the eight experimental subjects whose initial concept selection was in- 
consistent with their previous perceptions, four changed the perception 
to accord with the concept preference, while three changed the concept 
selection to accord with the prior perception. Of the eight subjects 
in the experimental group who did not see the comm.e.nt as a reinforcer, 
seven did not change from, their initial concept selection; four of these 
were correct. Only for the subjects who had. to shift from their initial 
selection can the. effect of the reinfcrcer be said to be clearly demr)n- 
strated. There were three such si?.bjects in the experimental groups and 
seven in the control groups. 
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Although relar ionships vcre expectf.'d between each o£ the per- 
sonality variables and L;he cht.ldren s perceptionsj it Is not surprising 
that Intellectual Acb ieveraent Responsibility 'was the vDSt predictive of 
the children/ s judgraeiu s oil reinforcers* meanings^ Ihe lAR is the only 
measure whicn refers directly ro reirfcrceruenij assessing whether the 
child accepts responsibi.lity i or rein .'or r.eaent outcome s of intellectual 
activity (posit Lve or negatxve) or attempts to attribute it to external 
persons or events, A child 'who accepts responsibll:.ty for bringing 
about his own rernforcenients may uc- so pert: ally because he feels 
optimistic about the usual outcomes or his behavior; therefore when he 
receives a reinforcer which is reia*: i /ely ambiguous, he tends to perceive 
it as positive. 



The only other signiricant parscnaUty-percention relationships 
which were found in this study occLrrc.d between the measures of content- 
intonation sensitivity and chtldro. 's manifest anxiety., For the first 
two questions of session A (ccncernirg the teacher's meaning and the 
child's feeling) the relacionsnips were linear^ with more anxious 
children being relatively more sensitive* to Lp.uonation than less anxious 
children. This seerns consistent, with theoretical notions concerning 
the nature and etiology of anxiety., if^ as a result of reinforcement 
history, the anxious child has come to view sicuations of evaluation as 
potentially dangerous, he may have learned r.o inv estigate, such situations 
carefully paying attention both r.o clear and obvious aspects (such as 
content) and to relatively subtle .and indirect aspects (such as intonation), 
as a protective measure. That *'i7<Lona: ion •sensitive'' subjects are con- 
sidering content, as well as intonation^ is indicated by the fact that 
the lowest scores on this measure hovered around zero, reflecting an 
approximately equal, reliance on the two aspecti.',, The ether extreme of 
obtained scores indicated almost complete reliance on content alone. 

Low anxious subjects pay little attention to intonation in regard to the 
first two questions, poss.ibl.v ht.c.ausc they feel no such need for vig- 
ilance and see conteni: as adeqiat.e for judging overt meaning and the 
child’s feeling (based on. that meaning;. It is only when the question 
refers to the teacher s liking for the child chat lew anxious children 
apparently see intonat.ior* as more relevant , possibly because liking must 
be judged from less explicit connotations (Table 8), It is not clear to 
the writers, however, why children who are modeTately anxious are rela- 
tively contenr.-ser.si Crve. in response to the liking quest icn. 



Just 3sS was i.n.d i c at.ed by the rav.ge iound 



ccntfc-»c was a., so 



for t.he sensitivity 
f'cund to be far greater 



measure, rhe relative, effect 

than the effect c£ intonarior'. fho.~e ana ly set which considered the 
two variables separately. It shujld be borne i.n mir.d that there is no 
way to equate the content and i.ntonat ion scaietJ use<i vi this study; 







accordingly, it is possible, although it does not seem likely, that the 
greater effect of content is due only to representation of a greater 
portion of the possible range. 

As might be expected, the analyses of variance show that the 
content effect is strongest for the qvjestion in session A which refers 
to the teacher* s explicit meaning; somewhat unexpectedly, the intonation 
effect is strongest with the question concerning the child's feelings 
(rather than the teacher's liking)o fiven here, however, the content 
effect is much stronger. This seems contradictory to the finding of 
Mehrabian and Wiener (1967) that intonation was more important to judg- 
ments of speaker attitude than content. It is possible that the dif- 
ference represents a developmental change (their subjects were college 
students), with intonation becoming more meaningful at older ages. The 
discrepancy may also be due to differences between the studies in stimuli, 
instructions, and evoked responses. 

Investigation of the content- intonation interactions in the 
present 3tudy can give some clues as to the functioning of intonation, 
in relation to content. Considering both sessions and all conditions 
together, it appears that neutral intonation has a weakening effect on 
positive or negative content which is equal to or greater than the effect 
of contradictory intonation. That this effect was greater in session A 
than in session B r.ay be due to the fact that the judgments were made on 
5-point scales in the former situation.j but were dichotomous choices in 
the latter; it is possible that this effect of neutral intonation is re- 
latively slight, and needs the finer scale to be evidenced. Another pos- 
sibility is that content is relatively more important in the direct rein- 
forcement condition (session B)^ and that therefore less attention is 
paid to differences in intonation. 

Still, it seems clear that when intonation has an effect which 
negates or diminishes that of content, it is most likely to be produced 
by neutral intonation. It seems possible that children, at this age at 
least, tend to discount intonation when it contradicts content (because 
it doesn't "make sense"), but to consider neutral intonation to indicate 
a lack of conviction or enthusiasm in the speaker, and therefore a re- 
latively weaker positive or negative meaning. It is possible that at 
older ages, intonation which contradicts content may begin to have greater 
salience (as in sarcasm) and thereby produce different effects. 

The response latencies (shown in Table 6) can be considered 
measures of the aniount of difficulty children had with their interpre- 
tations of comments in the various content- intonation cells in session B. 
While the neutral cells were generally the most difficult, cells in 
which content and intonation were contradictory also showed a high dif- 
ficulty level (having the longest latencies of the three positive content 
cells, and a latency only slightly below that of the neutral cell in the 
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negative content cells). It appears that the cnildren paise and ccdsider 
the contradictory messages before deciding dw much weight to give to 
the intonation portions. These findings ar«- consistent witti many others 
which have demonstrated that response latencies are longest when stimuli 
are most ambiguous or equivocal. 

Interpretation of the results obtained with the final experimental 
session is complicated by the discrepancy between the assessments of 
reinforcer perceptions made in the earlier sessions and those made, at 
the end of the 3rd session and by the strong form preference -nanifasted 
in this session. While it is possible that the post-session rcinforcer 
assessment represented only accommodations to the performance, there 
may also be other reasons for these discrepancies. For one thing, the 
particular reinforcer selected for the experimental groups was presented, 
in the earlier sessions, in such a way as to force an implicit compari- 
son with the 35 other reinforcers. The perceptions obtained in these 
situations then, were relative to the particular set of reinforcers in 
which the one in question appeared, while when this same reinfcrcer was 
used in the learning task, it was used alone. Without the presence of 
the other reinforcers, it may have had a different meaning to some of 
the children than it did in the earlier sessions. The time lag between 
the sessions (approximately 6 months) may also have occasioned develop- 
mental changes in some of the children, causing differences in specific 
perceptions. Thus, there are fairly good reasons for using measures of 
perception from each of the sessions. In addition, post-session measures 
are comparable to the earlier work in which either perception (i.e. Mand- 
ler and Kaplan, 1956) or ’’awareness” (Spielberger , Levin and Shepard, 

1962) have been assessed. 

The form preference was not discovered in time to alter the. design 
of the final session. If it had been, the design would probably have 
been changed so that all children were reinforced in such a way that 
color would be the correct concept. The test then would be to deter- 
mine for which children was the perception of the reinforcer strong 
enough to overcome what is apparently a very strong form preference. 

This of course was approximated in our reanalyses of the data for this 
session, which showed that there were three such subjects in the. ex- 
perimental groups and seven in the control groups. Undoubtedly, some 
of those subjects for whom the correct response coincided with their 
preference had equally strong perceptions of the reinforcers, but 
we have no way to determine how many. 

Nevertheless, these analyses, taken together, offer some evidence 
that the same verbal comment, ”I see”, served as a negative reinforcer 
for some children, and as a positive reinforcer for others, even though 
its effect on performance was not as strong as was that of ’’excellent”, 
a very positive reinforcer, or ’’that’s wrong”, a very negative reinforcer. 
Of course, since the initial perceptions were not as strongly held by 
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the experimental groups as they were by the control group Sp thfr-. 
was no reason to expect that the effect on performance would Ire 
great. 



This finding, coupled with the "flattening” effect foi:r.d fcr 
neutral intonation, has relevance for current research in homai* Itarn- 
ing which makes use of verbal reinforcement. Very often these studl*-.', 
use statements with ambiguous content (i.e., "mm-hmm") or stateynent:- 
with positive content (i.e., "good") spoken with a flat intonatlcn as 
reinforcers. If the chief focus of these studies is learning Itseif, 
rather than the reinforcement-performance interaction, the investi- 
gators would reduce error variance, possibly to a great extent, either 
by pretesting to determine the efficacy of the reiiiforcer to be usr,d, 
or by using either very positive or very negative statements, spoken 
with matching intonation. This would reduce the chance of individual 
differences in perception of the reinforcer occurring which could ob- 
scure the process being investigated. 

Results of the final session analyses showing that the person- 
ality variables here failed to relate either to the experimental groups’ 
perceptions of the neutral reinforcer or to their learning, may seem 
somewhat inconsistent with some of the results from the earlier sessions. 
It was expected, at least, that lAR, which showed direct effects on the 
initial measure of perception, both overall and for the neutral content - 
indifferent intonation cell, would show a similar effect on the neutral 
reinforcer used for the experimental groups. There are two differences 
between these sets of analyses, however; the earlier analyses used t’' 
total sample of 96 and used, as dependent variables, total cell percep- 
tion measures summed across the four items in each cell, while the 
later one used only one-fourth of the original sample and measured per- 
ception with a single item. If the personality effect was a very strong 
one, however, it would probably have shown up with these altered con- 
ditions as well. 

Although intelligence and the personality variables investigated 
in this study showed only slight effects on children's perceptions of 
meaning, nevertheless there was a great amount of variability in the 
perception measures within conditions, especially for the more ambigneus 
content- intonation combinations. This variability between children, 
coupled with the relatively great amount of within- sub j ect consistency 
of perceptions found between sessions A and B, indicates that there, may 
be other determinants of individual differences in such perceptions whieh 
the present study failed to measure. 

It seems probable that children's previous exposure to various 
types, patterns, and styles of verbal reinforcement is the principal 
determinant of these perceptual differences; for young children it 
could be expected that reinforcement styles used by their parents would 




25 



be dominant among the determinants. While no research has been done on 
this point directly, studies by Cairns (1963), Patterson, Littman and 
Hinsey (1964) and Heilbrun and Gillard (1966) have demonstrated relation- 
ships between parental behavioral styles and children’s responsiveness 
to social reinforcers. That parental styles of reinforcement, lit turn, 
may be differentiated by social class has been demonstrated by Bess and 
Shipman (1965; showing middle-class mothers to use more praise than 
lower-class mothers) and has been suggested by Wiener (1966; discussing 
his finding that intonation seemed more necessary to lower-class than 
middle- class children for interpreting the meaning of a reinforcer). 

It would be premature to attempt to apply or generalize the 
results of this study to educational settings. There are several 
elements of difference between the typical classroom (or even tutor- 
pupil) situation and the experimental conditions of this study which 
might influence some of the present findings. Perhaps the most important 
is a difference in the child’ s familiarity with the reinforcing agent. 

In a classroom, a child has the opportunity, through the course of a 
semeste~ or a year, to learn the teacher’s reinforcement style. He 
also has the opportunity to use additional cues which may accompany an 
evaluation (facial expression, posture, gestures, etc.) For these 
reasons it is possible that if a similar study were to be done in a 
classroom, or even in an experimental setting using the recorded voice 
of a teacher familiar to the children, with her characteristic evaluation 
statements (perhaps taped in classroom sessions), a smaller amoL.nt of 
perceptual variation might be found. Such an attempt at extension 
should precede more than tentative attempts at practical applications. 

Results of the present study do lerid themselves to certain 
implications for educational practice, however, assuming that they 
might be found to generalize to classroom situations. 

Teachers make great use of verbal evaluations in the classroom, 
usually without the opportunity of getting iirauediate feedback from the 
children about what they perceived the statements to mean. It might be 
suggested that teachers should keep in mind the possibility that dif- 
ferent children may interpret their comments differently, especially 
when the comments are not clearly positive or clearly negative in con- 
tent and intonation. It is likely that often comments which teachers 
intend to be neutral or noncommital are actually perceived as praise 
by some children, and as criticism by others. 

Besides trying to avoid using evaluations susceptible to various 
interpretations, teachers might try to learn how the different children 
in their classes interpret and respond to their various comments. While 
this kind of individual attention is not easy to give, and there may be 
difficulties in developing adequate methods for assessing such perceptions 
in classroom situations, the utilization of such assessments could 



ultimately increase the effectiveness of the teacher's use of verbal 
0 Yg]_uations to direct and stimulate children s learning* 



1 For a discussion of some possible additional implications of 
teachers' use of verbal evaluation in classroomSj with particular 
reference to the classroom social structure, see Solomon and Rosenberg, 

1964. 
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APPENDIX A. -- Achievement-related Affect Scale 



The authors developed the Achievement-related Affect scale be- 
cause there is presently no standardised children's group test of need 
for achievement. On the assumption that achievement motivation contains 
elements of behavioral striving for success and of affect associated 
with both success and failure, it was decided to construct items which 
might tap all of these. In order to get a measure, which might be 
generalizable across situations, some of the items dealt with school, 
some with peer competition in games and sports, and others with individual 
achievement efforts; some involved externally defined achievement 
standards, while others involved internal standards. The final scale 
was composed of twenty items. 

To avoid confounding achievement-related affect with an agreeing 
response tendency, ten of the items were so worded that "yes" constituted 
an aff-ach answer, while for the other ten, "no" did so. An attempt 
was made to minimize possible confounding effects of social desirability 
by constructing some items for which an aff-ach answer conflicted with 
socially approved behavior (i, e, good sportsmanship). The list of 
items used in this scale can be found in Table 10, 

Because this measure constituted a relatively minor portion of 
the total study, it was decided that lengthy pretesting of the scale, 
with assessment of validity and reliability, would not be done prior 
to its use in the present investigation, but that data obtained in the 
study would be used to assess the worth of the measure and the possibil- 
ities of further refinement. Table 11 shows correlations among individ- 
ual item scores and total scores. Inspection of these correlations sug- 
gests that the measure is not unitary; there is some indication that the 
items tend to cluster in terms of situational elements (items dealing 
with games, items dealing with school). In conjunction with other work 
recently reported concerning situational specificity of achievement-re- 
lated behavior (Solomon, in press), these findings indicate that it 
might be profitable to develop an instrument which would measure 
children's motivation for achieving or striving in a series of situa- 
tions, with separate measures for each situation, or situational para- 
meter. 
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Table 10, -*• Questions Used in the Achievement-Related 

Affect Scale 



C-ixc 


le One; 




YES 


NO 


1. 


If I have done my best, losing a game doesn't bother me. 


YES 


NO 


2. 


If I can't learn something easily, I feel bad and want 
to try harder. 


YES 


NO 


3. 


When I play a game with a friend, it doesn't matter to me 
if I win. 


YES 


NO 


4. 


I get very disappointed when I don't get a high grade on 
a test. 


YES 


NO 


5. 


I like trying to learn a new sport better than playing 
one I already know. 


YES 


NO 


6. 


If I have a good time making something, I don't care how 
well it turns out. 


YES 


NO 


7. 


When I play a game, I don't enjoy it much unless I am 
winning. 


YES 


NO 


8. 


When I work a puzzle, I don't mind stopping even if I 
haven't figured it out. 


YES 


NO 


9. 


When my friends and I are telling jokes, I'm happiest if 
mine are the funniest. 


YES 


NO 


10. 


In school, I don't care much if my answer is better than 
someone else's. 


YES 


NO 


11. 


When something I make turns out badly, I don't want to 
try it again. 


YES 


NO 


12. 


I feel very unhappy when I hand in school work that I 
know isn't very good. 


YES 


NO 


13. 


When I can't understand something my teacher explains, I 
don't worry about it much. 


YES 


NO 


14. 


When I draw a picture, I enjoy trying ways of improving 
it. 


YES 


NO 


15. 


When I play a game and don't win I sometimes get angry. 


YES 


NO 


16. 


When a friend beats me at a game, I don't mind because he 
is a friend. 
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Table 10 Continued 



If I can’t understand something in a book, I want to 
keep working until I do, 

I get pleased and excited when I get good grades. 

When I can do something aa well as my friends, I’m 
satisfied. 

If a g 3 mi teacher told me I wasn’t very good at a sport, 
I would want to give it up. 
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Table 11. — Correlations Among Achievement-Affect Questions 

and Total Score 
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Appendix B, -- Method of Selection and Lists of Reinforcery 



A list ot statements which are commonly used as verbal eval- 
uations, or reinforcers, was devised. This list was given to 15 adult 
judges, who were asked to rate the items as being positive, negative, 
or neutral. The 18 items (6 for each content level) which had achieved 
the best inter-judge agreement were selected and assigned to be used 
in session A, session B or both A and B, depending on their appropriate- 
ness in the situations. 

The final lists are reproduced below. Each comment was presented 
to subjects with three different intonations, pleased, indifferent and 
displeased. The investigators judged as to the adequacy with which 
the spoken comments represented the appropriate intonation levels. 



CONTENT 


SESSION A 


SESSION B 


positive 


1. 


Excellent. 


Excellemt. 


2. 


Very good. 


Very good. 
That's the way. 


3. 


I like that. 


4. 


That's coming along well. 


You're doing better. 


neutral 


1. 


Take your time 


Take your time. 


2. 


I see. 


I see. 


3. 


Interesting. 


Uh huh. 


4. 


That could have been worse. 


Try another one. 


negative 


1. 


Not very good. 


Not very good. 


2. 


Pretty bad. 


Pretty bad. 


3. 


Not that way. 


That's wrong. 


4. 


You're not too good at this. 


That was a poor choice. 
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Appendix C. — Interrelationships among Achievement-related 

and Personality Variables 



Although it was not directly relevant to the main hypotheses 
of the present study, the possible relationships among the various 
personality variables and the intellectual and school-related measures 
obtained from school records were important enough to be considered 
alone. Accordingly, correlations were run between the following 
variables: Intellectual Achievement Responsibility, positive events 

(lAR +) ; Intellectual Achievement Responsibility, negative events 
(lAR -); lAR total; Social Desirability (Soc Des); Anxiety (Anx, 
from the Children's Manifest Anxiety Scale); Scores on the Lie Scale 
of the Anxiety test; Achievement-related Affect (Xch-aff); IQ, as 
measured by the Kuhlman Anderson test; 4th grade grade point average 
(GPA, from grades in reading, language, spelling, writing, arithmetic, 
social studies, and science); and scores from the Metropolitian 
Achievement Test on Word Knowledge (Wd Knw), Word Discrimination 
(Wd Dis), Reading (Red), Spelling (Spl), Arithmetic Computation (Com), 
Arithmetic Problem Solving (Pro Sol), and Language (Lan). The results 
of these tests are shown in Table 12. Especially notable are the 
high correlations among IQ and the other achievement-related variables. 
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Appendix D. -- Supplementary Tables 




Table 13, -- Summary of Analyses of Variance Involving lAR 
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Table 15. -- Summary of Analyses of Variance Involving Anxiety 
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able 16. — Summary of Analyses of Variance Involving Ach-Aff 





Table 17. — Stunmary of Analyses of Variance Involving IQ 
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Table 18. — Summary of Trend Tests for the Effect of Personality 

Variables on the Neutral Content-Intonation Cell Scores 
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Table 19. — Summary of One-way Analyses of Variance Showing 

Effects of Personality Measures on Content-Intonation 
Sensitivity. 
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